PROFINITE GROUPS ASSOCIATED TO SOFIC SHIFTS 

ARE FREE 



ALFREDO COSTA AND BENJAMIN STEINBERG 

Abstract. We show that the maximal subgroup of the free profinite 
semigroup associated by Almeida to an irreducible sofic shift is a free 
profinite group, generalizing an earlier result of the second author for 
the case of the full shift (whose corresponding maximal subgroup is 
the maximal subgroup of the minimal ideal). A corresponding result is 
proved for certain relatively free profinite semigroups. We also establish 
some other analogies between the kernel of the free profinite semigroup 
and the /-class associated to an irreducible sofic shift. 



1. Introduction 

The study of maximal subgroups of free profinite semigroups has recently 
received quite a bit of attention in the literature [5,6, 10, 14,29,33]. Almeida 
discovered how to associate to each irreducible symbolic dynamical system a 
maximal subgroup of a free profinite semigroup [2,4,6]. In [4,6] he announced 
that this subgroup is invariant under conjugacy of dynamical systems, but 
flaws were detected in the arguments sketched in [4]. The first author used 
a different approach to successfully prove the conjugacy invariance of the 
maximal group [14]. The resolution of the flaws in [4] led to the paper [8], 
making possible for its authors to produce a proof according to the original 
approach of Almeida; such a proof appears in [16]. 

In [5] , Almeida studied the case of minimal systems associated to primi- 
tive substitutions and under certain hypotheses, the corresponding maximal 
subgroup was shown to be a free profinite group. An example of a non-free 
maximal subgroup, with rank two, associated to a primitive substitution 
was also obtained in [5]. It has since been proved by Almeida and the first 
author that the maximal subgroup associated to the Thue- Morse dynamical 
system is not free profinite and has rank three [7]. In particular, a ques- 
tion of Margolis from 1997 as to whether all maximal subgroups of a free 
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profinite semigroup are free was answered in the negative. Margolis also 
asked at this time whether all maximal subgroups were projective profinite 
groups and whether the maximal subgroup of the minimal ideal was a free 
profinite group. The first question was answered in the positive by Rhodes 
and the second author [29], whereas the second was answered positively by 
the second author [33]. 

The maximal subgroup of the minimal ideal is the maximal subgroup of 
the free profinite semigroup on X associated to the full shift X"^, which is 
an example of an irreducible sofic shift. It is then natural to ask whether 
the maximal subgroup associated to any irreducible sofic shift is free. A 
sofic shift is minimal if and only if it is periodic. In this case, Almeida 
and Volkov established early on that the corresponding maximal subgroup 
is free procyclic [10]. In this paper we show that the maximal subgroup 
associated to a non-minimal irreducible sofic shift is a free profinite group 
of countable rank, thereby generalizing the result for the minimal ideal [33] . 
An interesting feature of the proof is the crucial role played by the invariance 
of the subgroup under conjugacy of dynamical systems. A consequence of 
our results is that there is a dense set of idempotents whose corresponding 
maximal subgroups are free. Actually, we prove a stronger result that applies 
to certain relatively free profinite groups; the precise statement is left to the 
body of the article. 

Several intermediate results established in the paper are likely to be of 
interest to researchers in symbolic dynamics and finite semigroup theory. 
For instance, we characterize the syntactic semigroups of irreducible sofic 
shifts as precisely the generalized group mapping semigroups [23, 30] with 
aperiodic 0-minimal ideal. Fischer covers can then be interpreted as the 
corresponding Schiitzenberger graphs. 

The paper is organized as follows. The first section consists of prelim- 
inaries about semigroups and languages. This is followed by a section on 
sofic shifts. The necessary background on sofic shifts and their relation- 
ship with free profinite semigroups is given, as well as several new results. 
The fourth section reviews the wreath product of partial transformation 
semigroups and establishes our notational conventions for iterated wreath 
products. The fifth section states our main result and proves it modulo a 
technical lemma. The following section proves the technical lemma, which 
is based on the argument of [33]. Other results from [10] about the min- 
imal ideal of the free profinite semigroup are generalized to the minimal 
^-class associated to arbitrary irreducible sofic subshifts. Namely, in the 
seventh section the existence of computable idempotents in such ^-classes 
is established; in the last section, using the notion of entropy, we obtain a 
characterization of this ^-class that is used to prove that, roughly speak- 
ing, we can not reach its elements starting with strict factors and using only 
iterations of certain endomorphisms and compositions of implicit operations 
with low arity. 
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2. Semigroups and languages 

Throughout this paper we shah use basic notions from semigroup theory 
that can be found in standard texts [3,13,18,20,23,30]. In particular, recah 
that Green's (equivalence) relation ^ is defined on a semigroup S by putting 
s ^ t\l s and t generate the same two-sided principal ideal. The ^-class 
of an element s is denoted Jg ■ We use the notation s < ^ t \o indicate 
that the two-sided ideal generated by s is contained in that generated by t. 
This is a preorder descending to an order Sj ^ . Sometimes we use s> j; J 
as shorthand for Jg > / J- Similarly defined are the and .=Sf -relations, 
where right (respectively, left) ideals replace two-sided ideals. Analogous 
notation is used for and i^-classes. The intersection of M and ^ is 
denoted The J^-class of an idempotent e of a semigroup S* is a group, 
called the maximal subgroup at e. It can alte rnatively be defined as the 
group of units of the monoid eSe. 

By a compact semigroup S, we mean a non-empty semigroup with a com- 
pact Hausdorff topology such that multiplication is jointly continuous. A 
profinite semigroup is a projective limit of finite semigroups, or equivalently 
a compact totally disconnected semigroup. Basic information about com- 
pact and profinite semigroups can be found in [30, Chapter 3]. A ^-class of 
a compact semigroup S is regular if it contains an idempotent, or equivalent 
all its elements are von Neumann regular. If 5 is a compact semigroup and 
e, / G S are ^-equivalent idempotents, then Ge — Gf and so each regular 
^ -class has a unique maximal subgroup up to isomorphism of topological 
groups. Every compact semigroup has a unique minimal ideal, which is nec- 
essarily principal and hence closed. The minimal ideal is always a regular 
^-class. 

If X is a set, the free semigroup on X is denoted the corresponding 
free monoid is X* ; the respective profinite completions are denoted X+ and 
X*. A subset L C X+ is often called a language. A language is rational if 
it can be recognized by a finite state automaton. Equivalently, L is rational 
if there is a finite semigroup S and a homomorphism </?: X^ — > 6* so that 
L = (f~^(f{L). The category of onto morphisms recognizing L C X'^ has 
a terminal object A: X+ — > Sl called the syntactic morphism of L. The 
semigroup Sl is called the syntactic semigroup of L and is the quotient 
of X+ by the congruence that puts x = y if, for all u,v E X*, one has 
uxv G L <^=> uyv G L. See [17] for details. 

3. SOFIC SHIFTS 

3.1. Definitions and notation. A good reference for the notions that we 
shall use here from symbolic dynamics is [25] . Let X^ be the set of biinfinite 
sequences of letters of X indexed by Z. The shift on X'^ is the bijective map 
ax (or just a) from X^ to X^ defined by crxi{xi)iez) = ixi+i)iez- The 
orbit of X G X^ is the set {a^{x) \ /c G Z}. We endow X^ with the product 
topology with respect to the discrete topology of X. A symbolic dynamical 
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system is a non-empty closed subset of some X invariant under a. 
Symbolic dynamical systems are also called shift spaces or subshifts. 

Two subshifts ^ C and C are topologically conjugate if there 
is a homeomorphism ip: ^ 'W commuting with shift: i-p o ax = cry o (p. 
Such a homeomorphism is also called a topological conjugacy. Since we will 
consider no other form of conjugacy, we drop the reference to its topological 
nature. 

Let X = {xi)i(zi be an element of X'^. We may represent it by 
X = . . . a;_3X_2a^-i-a;oa;ia:2 • • • 

where the central dot indicates that the coordinate of x is the letter at its 
immediate right. 

By a factor of {xi)i^x we mean a word XjXj+i • • -Xj+n-ia^i+n (briefly de- 
noted by X[,j ,j+„]), where i ^ % and n > 0. If ^ is a subset of then 
we denote by L{X) the set of factors of elements of A subset L of a 
semigroup S is said to be factorial if it is closed under taking factors, and 
it is prolongable if for every element ?i of L there arc elements a.b E S such 
that aub G L. It is easy to prove that the correspondence J^' i-^- L{^) is an 
order isomorphism between the lattice of subshifts of X'^ and the lattice of 
non-empty, factorial, prolongable languages in X^ [25, Proposition 1.3.4]. 

A subset L of a semigroup S is said to be irreducible if, for all u,v E 
L, there exists it; G 5 so that uwv € L. Notice that, for factorial sets, 
irreducibility implies prolongability since if u G L, then uwuw'u G L for 
some w,w' £ S and hence wuw' G L since L is factorial. A shift is said 
to be irreducible if L{^) is an irreducible subset of this is equivalent to 
saying that ^ has a dense forward orbit [25]. One says that =^ is minimal 
if it contains no proper subshift. Minimal shifts are irreducible [25]. 

3.2. Sofic shifts. It is natural to consider those shifts whose associated 
language is rational. 

Definition 3.1 (Sofic shift). A shift ^ is sofic if L{^) is rational. 

A shift of finite type is a shift such that L( JT) = X+ \ X*FX* for 
some finite set F. Therefore finite type shifts arc sofic. Sofic shifts are 
exactly the quotients (or factors) of shifts of finite type. 

Recall that a shift is called periodic if it is the (finite) orbit of a word of 
the form x^ = ■ ■ ■ uu.uuu . . . with u G X'^ . The following is well known. 

Lemma 3.2. A sofic shift is minimal if and only if it is periodic. 

Proof. It is easy to see that every periodic shift is minimal. Suppose con- 
versely that ^ is a minimal sofic shift. Since L{^) is an infinite factorial 
rational language, by the Pumping Lemma we can find a non-empty word 
u G X+ so that G L{^) for all n > 0. The orbit of a;„ = . . . uuu.uuuu . . . 
is then a subshift of ^ , which is hence periodic by minimality. □ 

An example of an irreducible sofic shift is the full shift X'^. 
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3.3. Coding. Let be a positive integer. Let Yat be the alphabet X . 
We shall use the notation [u] for a word u € when we want to consider 
it as a letter of Yat. 

Let iV > and define ^n- ^ by 

/37v((xi)iez) = i\x\i,i+N-i]\)i&- 

For example, 

(3z{- ■ ■ X-:iX^2X-i.XQXiX2 ■■■) = 

■ ■ ■ [x_2X_iXo][X-.iXoa;i].[xoXiX2][xiX2X3][j;22;3X4] • • • 

Given a subset of X^, denote by ^[^1 the set I3n{^)- The following 
is [25, Example 1.5.10]. 

Lemma 3.3. If ^ is a subshift of X^, then Jfl^l is a subshift of (Iat)^ 
and the map '■ ^ ^ ^^'^^ is a conjugacy. 

Given a word u, denote by alph(M) the set of letters occurring in u. We 
extend this notation to shifts C by putting alph(^)=XnL(jr). 

Lemma 3.4. Let ^ be a sofic shift, which is not minimal. Then there is 
a conjugate shift '3^ of ^ for which there is a non-empty word z € L{'3^) 
such that z+ C L(^) and alph(z) C alph(^). 

Proof. Suppose that ^ C X^ is a sofic shift, but not minimal. By the 
Pumping Lemma, there is a non-empty word w so that C L{^). The 
orbit of j;^ = . . . www.wwww ... is periodic and thus a minimal shift con- 
tained in J^T. Since ^ is not minimal, the set L{^) \L{xw) contains some 
element v. Because x^ = x^,™ for all m > 0, we may as well suppose that 
\w\ > \v\. Using that L(J^) is prolongable, we may in fact assume \w\ = \v\. 
The fact that v ^ L{xw) then translates into saying that v is not a cyclic 
conjugate of w. Set N = \w\ = \v\. 

RecaU that Jfl^l is conjugate to 3y by Lemma [331 Suppose that w = 
ai • • • otv with the ai G X. Then setting 

z =[ai - ■ ■ aiv][a2 • • • aNai] ■ ■ ■ [aMaia2 ■ ■ ■ aN-i] 

we have z"*" C L{I^^^^) (as I3n{xw) £ JTt^l). But since v is not a cyclic 
conjugate of w, we have [v] ^ alph(z). On the other hand, since v has length 
N and is a factor of some x £ ^ , the letter [v] is a factor of(3Nix) G Jft^l 
Thus [v] G alph(jr[^l). □ 

3.4. Regular ^-classes of compact semigroups. The goal of this sub- 
section is to establish a bijection between regular ^-class of a compact 
semigroup S and non-empty, factorial, irreducible subsets (Fl-subsets) of S 
which are closed topologically. This sets the stage for the connection with 
symbolic dynamics. We begin with a lemma on inverse images of such sets. 
We remark that a factorial set is a union of ^-classes. If 5" is a compact 
semigroup, 5*^ denotes 5 with a functorially adjoined identity element 1, 
which is topologically an isolated point. 
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Lemma 3.5. Let 99: S ^ T be a homomorphism of semigroups and suppose 
7^Lcr. Then: 

(1) If L is factorial, ip~^{L) is factorial; 

(2) If if is surjective and L is irreducible, then 7^ (p~^{L) is irreducible. 

Proof. For (1), if if is a factor of ip~^{L), evidentally (p{w) is a factor of L 
and so (p{w) € L, whence w G ip~^{L). Thus (p~^{L) is factorial. On the 
other hand, suppose ip is onto and L is irreducible. Assume u,v ^ Lp~^{L) 
and choose u; G T so that ip{u)wip{v) G L. Then if i5 is a preimage of w, 
one has uwv G ip~^{L). This completes the proof. □ 

The following proposition characterizes the closed Fl-subsets of a compact 
semigroup. It combines the fundamental idea of Rhodes for lifting regular 
^-classes [23,30] and an idea of Almeida on irreducible shifts [6]. If ^ is a 
subset of a semigroup, we denote by Fact(^) the set of all factors of A. 

Proposition 3.6. Let S be a compact semigroup. 

(1) If A is a closed, non-empty, factorial, irreducible subset, then there 
is a unique minimal ^ -class J[A), called the apex of A, such that 
J {A) C A. Moreover, J is regular and A = Fact(J(^)). 

(2) If J is a regular ^ -class, then Fact(J) is a closed, non-empty, fac- 
torial, irreducible subset with apex J . 

Consequently, regular ^ -classes of S are in bisection with closed Fl-subsets. 

Proof. To prove (1), first observe that A is a union of ^-classes. Wc next 
show that every element s G ^ is ^-above a minimal ^-class of A. Let 

be the set of all closed ideals of S intersecting A, which are contained 
in the principal ideal generated by s. Then is non-empty (as it contains 
the principal ideal generated by s) and by compactness the intersection of 
any descending chain of elements of ^ meets A in a non-empty subset, and 
hence belongs to . Thus ^ has a minimal element / by Zorn's Lemma. 
If a G A n /, then the principal ideal generated by a intersects A and is 
contained in /. Thus I is a principal ideal by minimality and so A contains 
a minimal ^-class, which is ^-below s. 

Suppose Ji, J2 are minimal ^-classes of A (perhaps equal). Let u G Ji 
and V G J2. Then by irrcducibility, there exists w E S so that uwv G A. 
Clearly, uwv < ^ Ji, J2- Wc conclude by minimality that .I\ = Ji and J^H Ji 
is non-empty. Thus J\ is regular and unique. From now on we denote it 
J(A). Clearly, Fact(J(A)) C A. Conversely, if a G A, then we know a is 
^-above a minimal ^ -class of A, which must be J{A) by uniqueness. This 
establishes (1). 

For (2), first note that if {xa} is a net in Fact (J) converging to x e S, 
then we can find, for each a, elements Ua,Va G so that UaXaVa G J. 
By passing to a subnet, we may assume that ^ u and v^ ^ v and 
hence Then since ^-classes of a compact semigroup are 

closed [30, Proposition 3.1.9] it follows that uxv G J and so a; G Fact (J). We 
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conclude Fact(J) is closed. It is clearly factorial. Suppose n, t> E Fact(J). 
Then we can find x,y,x' ,y' € S"^ so that xuy,x'vy' € J. Since J is regular, 
we can find an element w £ J so that xuywx'vy' G J. Indeed, there is an 
■^-class of J so that Lxuy H R contains an idempotent and an ^-class L 
of J with Rx'vy' n L containing an idempotent. We can then take w to be 
any element of the c^-class RD L. Hence uywx'v € Fact (J) and ywx' £ S. 
Thus Fact(J) is irreducible. Evidentally, J is minimal in Fact(J) and hence 
is the apex of Fact (J). This completes the proof. □ 

As a corollary, we deduce a result on lifting regular ^-classes for compact 
semigroups [30, Lemma 3.1.14]. The analogue for finite semigroups is well 
known [23,30]. If A is a subset of a semigroup S, then E{A) denotes the 
idempotent elements of A. 

Lemma 3.7. Let ip: S ^ T be a continuous surjective homomorphism of 
compact semigroups and let J be a regular ^ -class ofT. Then: 

(1) There is a unique minimal ^ -class J' of S so that ip{J') ^ J, which 
moreover is the apex o/ 93^^ (Fact (J)); 

(2) The ^ -class J' is regular and (p{J') = J; 

(3) Each ^i^- class, ^-class and M'-class of J' maps onto a corresponding 
class of J; 

(4) ^iEiJ')) = EiJ). 

In particular, each maximal subgroup of J' maps homomorphically onto a 
maximal subgroup of J and each maximal subgroup of J is the image of a 
maximal subgroup of J' . 

Proof. By Proposition 13.61 the set Fact(J) is a closed Fl-subset. Hence, 
by Lemma [3.51 (/3~^(Fact( J)) is a closed Fl-subset and thus contains by 
Proposition l3.6l a unique minimal ^-class J', which moreover is regular, and 
ip~^{Fact{J)) = Fact(J'). Suppose x € J where x = ip{s) with s € Fact(J'). 
Then we can find u,v € so that usv € J'. Then ip{usv) € J. Since 
if is onto, we can find a,b £ so that ip{ausvb) = x. Hence ausvb G J' 
by minimality. We conclude <p{J') 5 J- But ip{J') must be contained in a 
^-class of T so (/?( J') = J. 

Suppose R is an ^-class of J' and that t M <p{r) with r £ R. Then we 
can find s G 5 so that (p{r)ip{s) = t. Then rs < j r and so rs G J' by 
minimality, whence rs r by stability of compact semigroups [30, Chapter 
3]. Thus t G ip{R). 

Next suppose G' is a maximal subgroup of J' with identity e. Let G be 
the ^ -class of J containing the image of G'. If (7 G G and s G 5" is any 
preimage of g, then ip[ese) = g and so, by minimality, ese G J'. Stability 
shows in fact ese G G' . Thus <f{G') = G. Now let H' be an J^-class 
equivalent to G' and let H be the J^-class of J into which H' maps. Fix 
h G H'; so ^{h) G H. Green's Lemma implies that 

H = <f{h)G = ifihMG') = (p{hG') = fiH'). 
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Because every ^-class in a regular ^ -class is =^-equivalent to a maximal 
subgroup, this completes the proof of (3). 

Finally, to prove (4) suppose that e G E{J) and let A = (p~^{e) H J' ^ (l>. 
Since ^-classes in a compact semigroup are closed [30, Proposition 3.1.9], 
the set A is closed. But ii s,t G A, then ip{st) = e and st < j s. Thus by 
minimality st G J' and so st € A. Thus A is compact semigroup and hence 
contains an idempotent [30, Corollary 3.1.2]. □ 

If V is a variety of finite semigroups, then F-\/{X) denotes the free pro-V 
semigroup on X [3,30]. 

Lemma 3.8. Let L he a subset of . Let l: X~^ — > F-y^X) be the canonical 
morphism. If L is irreducible then the subset i{L) of Fy{X) is irreducible. 
Moreover, if L is factorial and V contains the syntactic semigroup of L, 
then i[L) is factorial. 

Proof. Suppose u,v G i{L). Then u = limi(n„) and v = limi(f„) for some 
sequences {vn} of elements of L. For each n, there is Wn G X^ such 

that UnWnVn G L. It follows that uwv G i{L) for some accumulation point 
w of {i{wn)}. This completes the proof of irreducibility. 

Suppose V contains the syntactic semigroup of L. Then i{L) is open 
and i^^(^i{L)^ = L [3]. Let u G i^{L). Take a factorization u = xwy, 

where x and y are allowed to be 1. Then x = limt(x„), w = lim L{wn), 
and y = lim/,(y„), for some sequences {wn}, {Vn} of elements of X* 

(where = 1). Since l{L) is open, for all sufficiently large n, we have 
XnWnUn ^ '■""^ ^''(-^)^ = L. Since L is factorial, this implies that w G 
thus i{L) is factorial. □ 

If V contains the variety of finite nilpotent semigroups, then i is an embed- 
ding of X~^ in F^^{X), and thus we consider l to be an inclusion map. There 
are sofic shifts J^T such that L{^) is not factorial in -Flsi(^) [16, Proposition 
3.3], where LSI is the variety of finite semigroups whose local submonoids 
are semilattices. 

From Proposition 13.61 and the ffi'st part of Lemma 13.81 we immediately 
deduce the following result of Almeida announced in [6] and proved in [2]. 

Proposition 3.9. Let ^ C X^ be an irreducible shift. Let be a variety of 
finite semigroups such that i[L{^)) is factorial, where l: X^ — s- Fy{X) is 
the canonical morphism. Then there is a unique minimal ^ -class, denoted 
J{^), of Fy{X) intersecting i{L{^)). Moreover, J{^) is regular and is 
^ -below each element of i{L{^)). 

It was proved in [8] that if V is a variety of finite semigroups such that 
V = A (£) V then L is a factorial subset of F^/{X) whenever L is a factorial 
subset of Hence, thanks also to Lemma ESJ one can define the ^-class 
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J{^) in Proposition 13.91 whenever at least one of the fohowing conditions 
holds: 



(2) V contains the syntactic semigroup of L{i^). 

The maximal subgroup of J(j2r) is called the profinite group associated 
to the irreducible shift it is known to be a conjugacy invariant of ^ if 
V = V * D, where D is the variety of finite semigroups whose idempotents 
are right zeroes, and V contains the two-element finite semilattice [14]. 

It is easy to see that if H is a variety of finite groups then the variety H 
of finite semigroups whose subgroups are in H is an example of a variety of 
finite semigroups satisfying the equations V = A@V and V = V*D [18,30]. 

3.5. Sofic shifts and generalized group mapping semigroups. In this 
section we establish a connection between irreducible sofic shifts and gen- 
eralized group mappings semigroups with aperiodic 0-minimal ideals, which 
we term AGGM-semigroups to be consistent with the notation of [30]. 

Definition 3.10 (AGGM-semigroup). A finite semigroup S is called gener- 
alized group mapping if it acts faithfully on the left and right of its minimal 
ideal or it has a 0-minimal ideal on which it acts faithfully on both the left 
and right. The ideal in question, called the distinguished ideal, is unique 
and regular [30, Proposition 4.6.22]. If the ideal is aperiodic, then we call S 
an AGGM-semigroup. 

Generalized group mapping semigroups were introduced by Krohn and 
Rhodes in their work on the complexity of finite semigroups; see [22,23,28, 



Notice that an AGGM-semigroup is either trivial or contains a and the 
distinguished ideal is 0-minimal. If S is an AGGM-semigroup, then by the 
distinguished ^ -class of 5, we mean the unique ^-class if S is trivial and 
otherwise we mean / \ {0} where I is the distinguished ideal. It follows 
from [30, Proposition 4.6.37] that S is an AGGM-semigroup if and only if 
there is a regular ^-class J of S with the following property: for all s, t G 5, 
one has s = t if and only if, for all x, y € J, 



Moreover, in this case J is the distinguished ^-class. From now on, if S 
is an X-generated profinite semigroup, then [w\s will denote the image of a 
word w G X'^ in S. 

Theorem 3.11. Let S be a finite X -generated semigroup. Then S is the 
syntactic semigroup of L{^) for an irreducible sofic shift X C if and 
only if it is an AGGM-semigroup. 

Proof. Suppose first that ^ is a sofic shift and S is the syntactic semigroup 
of L{^). li ^ = X^, then S is trivial and there is nothing to prove. So 
assume is a proper shift. Then S has a and L(^) is the full inverse 



(1) V = A@V; 



30,34]. 
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image oi S \ {0} since S is the syntactic semigroup of a coideal in X^. Let 
J be a minimal non-zero ^-class of S. We first claim that J is regular. 
Indeed, if [u]s G J, then by irreducibility we can find w € X'^ so that 
uwu G L(^). Then ^ [uwu]s </ [u\s and so by minimality [uwu]s G J- 
Hence [il'u]5 € J and so 7^ 0. Thus J is regular. Now suppose that 
[s]S) [i\s are such that, for all x,y & J, one has x[s]sy G J <;=^ x[t]sy G J. 
Let u,v € X+ and assume that usv G L{^). Let [z] G J. By irreducibility, 
we can find wi,W2 G X+ so that zwiusvw2Z G L{^). Set x = [zwiujs and 
y = [t;tt;22;]s'- Then x,y G J and xfsj^y G J. Thus x[t]sy G J and hence 
zwiutvw2Z G L(J?r). It follows utv L(^). A symmetric argument shows 
that utv G L{9y) implies usv G L{3y). Thus [s\s = [t\s- This establishes 
that S is an AGGM-semigroup. 

Conversely, assume S is an AGGM-semigroup. Let J be the distinguished 
^ -class of S and let vr: X+ ^ S" be the canonical surjection. Then 
Fact (J) = S \ {0} is a non-empty, factorial, irreducible subset of S by 
Proposition 13.61 Thus t:~^{S \ {0}) is a non-empty, factorial, irreducible 
rational subset of X^ (by Lemma l3.5p and hence of the form L(^) for an 
irreducible sofic shift ^ C X^. It remains to show that S is the syntactic 
semigroup of tt~^{S \ {0}). To prove this, it suffices to verify that, given 
m,n £ S such that rms ^ rns 7^ for all r,s G S^, one has m = n. 

By the remark before the theorem, it suffices to prove that, for all x,y £ J, 
we have xmy G J <^=^ xny G J. But xmy G J if and only if xmy ^ 0, if 
and only if xny ^ 0, if and only if xny G J. This completes the proof of the 
theorem. □ 

Remark 3.12. The Fischer cover [11, 19] of an irreducible sofic shift ^ is 
nothing more than the Schiitzenberger graph associated to the faithful right 
action of the syntactic semigroup of L(^) on an =^-class of its distinguished 
^-class. 

The ^-classes corresponding to irreducible sofic shifts admit the follow- 
ing topological characterization. 

Proposition 3.13. Let W he a variety of finite semigroups. Then a regular 
^ -class J of F-y(X) (for a finite set X) is of the form J[^) for an irre- 
ducible sofic shift ^ with L{^) a W -recognizable set if and only i/Fact(J) 
is clopen. 

Proof. Let l: X~^ Fy{X) denote the canonical morphism. Suppose first 
that J = J[^) for an irreducible sofic shift ^ with L{^) a V-recognizable 
set. Let A: F-y{X) — > be the continuous homomorphism induced by the 
syntactic morphism for L(^). Then Fact(J) = i{L{a^)) = \-^{S.r \ {0}) 
and hence is clopen. 

Conversely, suppose Fact(J) is clopen. Proposition 13. 61 shows that Fact( J) 
is factorial and irreducible. Then L = t~^(Fact(J)) is a V-recognizable 
language and i{L) = Fact (J) [3]; in particular, L 7^ 0. Moreover, it is 
factorial by Lemma 13.51 It remains to prove that L is irreducible. It will 
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then follow that L = L(^) and J = J[^) for an appropriate irreducible 
sofic shift Suppose u,v G L and L{u)wi{v) G Fact(J) with w G F-v{X). 
Then w = lim i{wn) for some sequence {wn} ^ X"^. Then i{uwnv) — > 
i{u)wi{v) E Fact (J) and hence, as Fact (J) is open, for n large enough 
uWnV G i~"^(Fact(J)) = L. This completes the proof of irreducibility. □ 

An important lemma that we shall exploit frequently is the following. 

Lemma 3.14. Let J^T C be an irreducible sofic shift whose syntactic 
semigroup is contained in a variety of finite semigroups V and suppose we 
have a commutative diagram of continuous surjective morphisms 

FviX)^^^S 




where A: Fy^X) S^%- is the continuous extension of the syntactic mor- 
phism of L{^). Then: 

(1) ip{J{~3^)) is a regular ^ -class J of S; 

(2) J is the unique minimal ^ -class of S with ip{J) contained in the 
distinguished ^ -class of S^- ; 

(3) J{^) is the unique minimal ^ -class of Fy{X) mapping into J; 

(4) The image under (p of each maximal subgroup of J{^) is a maximal 
subgroup of J. 

Proof. Let Jq be the distinguished ^-class of S",^- and suppose that J is the 
unique minimal ^-class of T with ip{J) C Jg guaranteed by Lemma 13.71 
Then J is regular. To complete the proof, it suffices by Lemma [3. 71 to verify 
that J{^) is minimal among ^-classes of F-\/{X) mapping under if into 
J. Suppose that u < j J{^) with ip{u) £ J. Then ^p{ip{u)) G Jq and hence 
u G L{¥). It follows that u G J(^) by definition of J( JT). □ 

The following lemma is an immediate consequence of Lemma 13.41 The 
hypothesis V = V * D is there to guarantee that J{'3^) is well defined, since 
for two conjugate shifts ^ and '3^ , the syntactic semigroup of L(<^) belongs 
to V if and only if the syntactic semigroup of L['3^) does [15]. 

Lemma 3.15. Let J^T C be an irreducible sofic shift whose syntactic 
semigroup is contained in a variety of finite semigroups V with V = V * D 
and V containing all finite semilattices. There there is a conjugate irre- 
ducible sofic shift L['3^) over an alphabet Y , an idempotent e G J{'3^) and a 
word z G so that e = z'^e and alph(2:) C alph(^^). 

Proof. Let '3^ and z be as in Lemma 13.41 Then z'^ G z+ C L['3^) and so by 
minimality of J(^), we can find x,y G Fyr{YY so that xz'^y G J(^). bmce 
J{'3^) is regular, there are idempotents /, /' G J[^) so that fxz^yf = 
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xz^y. Consequently, z'^yf € J{'3^)- By regularity of J{'3^)^ we can then 
find an idempotent e G J{'3^) with e M z^yf. Then z'^e = e as required. □ 

The set of idempotents in a profinite semigroup is closed and hence a profi- 
nite space. It turns out that the idempotents in ^-classes corresponding 
to irreducible sofic shifts are dense in relatively free profinite semigroups. 

Proposition 3.16. Let W he a variety of finite semigroups and X a finite 
set. Let A he the set of idempotents of F^/[X) that helong to a ^ -class 
of the form J(^) for some irreducihle sofic shift ^ C X"^ with L{^) a 
\ -recognizahle set. Then A is dense in E{F-y{X)), 

Proof. Let e € E{Fy{X)). Then a basic neighborhood of e is of the form 
7r~^(7r(e)) where vr: F\-{X) — > y is a continuous homomorphism to an ele- 
ment V of V. Let J be the ^-class of 7r(e) and choose a minimal ^-class 
J' of F-y{X) with vr(J') C J as per Lemma 13.71 In particular, J' is regular 
and Fact(J') = 7r^^(Fact(J)), and hence is clopen. Proposition 13.13) then 
implies that J' = J{^) for an irreducible sofic shift J^T with L(^) a V- 
recognizable set. By Lemma l3.7| there is an idempotent f ^ J' = J[^) 
with 7r(/) = 7r(e). Thus / € Ar\iT~'^{TT{e)), establishing that A is dense. □ 

4. The Schutzenberger representation and wreath products 

In this section we collect a number of standard facts concerning finite 
semigroups, which can be found, for instance, in [13,23,30]. 

The Schiitzenherger representation. Let J be a regular ^-class of a finite 
semigroup S. Fix an ^-class R of J. Then S acts on the right of R by 
partial functions by simply restricting the action of S on the right of itself. 
More precisely, for s € 5" and x £ R, define 



The resulting faithful partial transformation semigroup does not depend 
on R up to isomorphism [30, Chapter 4, Section 6] and we denote it by 
{R,RMj{S)). We use pj: S ^ RMj{S) for the associated quotient map. 
The map pj is called the (right) Schiitzenherger representation of S on J. If 
G is a maximal subgroup contained in R, then the restriction of the action of 
G to G C i? is the regular representation and hence faithful. Since RMj(S') 
depends only on J and not R, it follows that pj is injective on each maximal 
subgroup of J. The results of [30, Chapter 4, Section 6] imply that pj{J) 
is a regular ^-class of RMj(5') and the Schiitzenherger representation of 
Pj{S) on it is faithful. 




xs xs E R 

undefined else. 
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Retaining the above notation, denote by L{J) the set of ^-classes of S 
in J. There is an action of S by partial transformations on L{J) given by 



The resulting faithful right partial transformation semigroup is denoted by 
(L(J), RLM j(S')) and the quotient map by fj,j: S RLMj(S'). See [30, 
Chapter 4, Section 6] for details. 

Wreath products. Let us briefly recall the wreath product of partial trans- 
formation semigroups [18,30]. In this paper, by a partial transformation 
semigroup, wc mean a pair {B,S) where S* is a semigroup acting faithfully 
by partial transformations on the right ol B. If the maps in S are total, 
then we use the terminology transformation semigroup. In the case that S 
is a monoid (group) and the identity acts as the identity, then we say it is 
a partial transformation monoid (group). If S is a set, then B will denote 
the semigroup of all constant maps on B. 

It will be convenient to use in this paper the formulation of wreath prod- 
ucts in terms of row monomial matrices [30, Chapter 5] or [23]. If 5 is a 
semigroup, then is the semigroup obtained by functorially adjoining a 
multiplicative zero (so a zero is added to S even if it already had one). 
Let 5 be a non-empty semigroup and 5 a set. Then RMb{S) consists of all 
B X S-matrices row monomial matrices over equipped with usual matrix 
multiplication. Recall that a matrix is row monomial if each row contains 
at most one non-zero entry. The construction RMb{—) is functorial. Sup- 
pose that {B,T) is a partial transformation semigroup. The full partial 
transformation monoid is easily seen to be isomorphic to RMb{{1}) [30, 
Chapter 5]. Thus we may view T as a subsemigroup of RMb{{1}). Let 
tt: RMb{S) —>■ RMb{{1}) be the projection. Then we define the wreath 
product Si {B,T) = -k'^T). The projection RMb{S) -> RMb{{1}) re- 
stricts to a surjective morphism S I {B,T) — > T. Notice that (— ) I {B,T) is 
functorial and preserves surjective morphisms. If iS is a group and {B, T) is 
a transformation group, then S I {B, T) is a group. 

Let J be a regular ^-class of a finite semigroup S with maximal subgroup 
G. Denote by J° the semigroup obtained by adding a multiplicative zero 
to J and putting 



for X, y G J. Then is 0-simple and hence isomorphic to a Rees matrix 
semigroup ^^{G, A, B, C) where C: BxA^G^is the sandwich matrix [13, 
23,30]. Fix ttQ ^ A and ^ B. Then without loss of generality we may 
assume that each non-zero entry of row 5o and of column ao of C is the 
identity of G [23,30]. We identify G with the maximal subgroup oq x G x 6o- 




xs G J 
else. 



(4.1) 




xy E J 
else. 
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Recall that B can be identified with the set of ^-classes of J [30]. Notice 
that each element of J acts on i? as a rank 1 partial map (cf. (j4.ip ). where 
the rank of a partial transformation is the size of its image. Moreover, J is 
transitive on B. 

There is a well-known embedding RMj(5) ^ Gl{B, RLM j{S)) such that 
an element s = {a,g, b) £ J is sent to the matrix M(s) all of whose non-zero 
entries are in column b and with M(s)b'b = CyaQ [30, Proposition 4.6.42]. 
In particular, if s = {ao,g, &o) is an element of our maximal subgroup, then 
every non-zero entry of column bo of M(s) is g and in particular M{s)bQbo ~ 
g, establishing yet again that the Schiitzenberger representation is faithful 
on the maximal subgroup G. 

The following well-known lemma elucidates the structure of wreath prod- 
ucts. See, for instance, [12, Theorems 9.3.10 and 9.3.15]. 

Lemma 4.1. Let S = Gl {B,T) where G is a non-trivial finite group and 
T is a finite transitive partial transformation semigroup consisting of maps 
of rank at most 1 and denote by vr: G I {B,T) T the wreath product 
projection. Then S is simple if T consists of total maps and otherwise S is 
0-simple. The maximal subgroup of the non-zero ^ -class of S is isomorphic 
to G. More precisely, if e ^ Q is an idempotent such that the image of 7r{e) 
is {b}, then Ge ^ G given by ipis) = Sbb is an isomorphism. 

Proof. First we claim that T is simple if it consists of total maps and oth- 
erwise is 0-simple. If T consists of total maps, it is a right zero semigroup 
and hence trivially simple. Otherwise, suppose 7^ t € T is not total and 
that bQ is not in the domain of t. Let {6} be the image of t. By transitivity, 
there is an element t' £ T with bt' = 60 • Then tt't = so € T. To see 
that T is 0-simple, suppose that t,t' £ T are non-zero. Let bt,bt' be the 
unique elements in the image of t,t', respectively. Let b be an element of 
the domain of t'. By transitivity, we can find u,v £ T with btu = b and 
bt'V = bf. Then tut'v = t and so t € Tt'T. A symmetric argument shows 
that t' G TtT. Thus T is 0-simple. 

Next we verify that 7r(x) = iT{y) implies x y. This will imply the 
simplicity or 0-simplicity of S (depending on which case we are in). Let 
/ G T be an idempotent that is .^-equivalent to 7r(x) = t = Tr{y) (T is 
regular). Then / has the same domain as t. Let z £ S he given by putting 
Zi,if = yi,itx~^^^ if if (equivalently, it) is defined and otherwise. Then one 
immediately verifies that zx = y. A symmetric argument establishes that 
X y. 

Now suppose that e is an idempotent of S such that 7r(e) has image {b}. 
We must show -0 defined as above is an isomorphism. First note that every 
element s of 5 that is =Sf-equivalent to e satisfies Bii{s) = {6}. Thus each 
element of Gg has all its non-zero entries in column b. It now follows that if 
s, s' G Ge, then {ss')bb = Sbbs'bb, that is, -0 is a homomorphism. In particular, 
we have 1 = -0(6) = Cbb- 
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To see V' is injcctive, note that s £ Gg implies s = es. Since s, e have ah 
their non-zero entries in column b, it follows that s^'b = eb'b^bb and so s is 
determined by ip{s) = Thus tp is injcctive. Finally to verify tp is onto, 
assume g & G. Let s be the element of 5* obtained from e by changing ebb 
to g and leaving all other entries the same. Then 7r(ese) = 7r(e^) = 7r(e) 
and so ese ^ e by the above. Hence ese J^f e. Since ebb = !> clearly 
{ese)bb = ebbSbb^bb = 9- Thus it is onto. □ 

If (A, S) and (B, T) are partial transformation semigroups, then one has 
that {A X B,S I {B,T)) is a partial transformation semigroup, which we 
denote {A,S) I {B,T). Here ii M e S I {B,T), then (a,6)M is defined if 
and only if M^y / for some b' e B and riAff,;,/ is defined. The result is 
then (aMhf,/ ,b'). The wreath product of partial transformation semigroups 
is known to be associative [18]. We can view an iterated wreath product 
Sl{A, T) I {B, U) as \B\ x \B\ block row monomial matrices where the blocks 
are \A\ x \A\ row monomial matrices over S. The term block entry shall refer 
to a non-zero matrix from S I {A, T) while the term entry shall always mean 
an element of the semigroup 5". In general matrices, and in particular block 
entries, shall be denoted by capital letters for the remainder of the paper. 

5. Statement of the main result and a reduction 

In this section, we state our main result and reduce its proof to a technical 
construction that will be presented in the next section. Recall that a subset 
y of a profinite group G converges to the identity if each neighborhood of 
the identity contains all but finitely many elements of y. A pro-H group 
F is free pro-H on a subset Y converging to the identity if given any map 
t: Y ^ H with H pro-H and t{Y) converging to the identity, there is a 
unique continuous extension of r to F. The cardinality of Y is called the 
rank of F. Any free pro-H group on a profinite space is free on a subset 
converging to the identity [31]. 

The following theorem was proved in [10, Theorem 7.5] for the case where 
H consists of all finite semigroups. We provide here the proof of the general 
case. Recall that C C X+ is called a code if C'^ is a free semigroup on C. A 
code is said to have synchronization delay at most d, if for all {c,cf) G C^xC^ 
and all x,y E X*, one has xcc'y G C"^ if and only if xc, dy G C'^ . 

Lemma 5.1. Let u G be a primitive word. Then, for any m > and 
any x,y E X* , one has xu^y G u'^ if and only if x,y G u* . 

Proof. Suppose xu"^y G W^. Then we may write x = u^x' and y = y'u^ so 
that |a;'|, \y'\ < u. If we can show that x' = 1 = j/', we are done. Suppose 
at least one of x' and y' are non-trivial. Then since x'u^y' G by length 
considerations we must have x'vT^y' = n™^^ and + = \u\. But then x' 
is a prefix of u and y' is a suffix of u and so x'y' = uhy length considerations. 
But then x'u^y' = x'y'u"^~^x'y' and so = y'u"^~^x'. Thus y' is a prefix 
and x' is a suffix of u. Length considerations then yield y'x' = u = x'y'. 
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But then x', y' are powers of a word w and hence n is a proper power, 
contradicting primitivity. Thus x' = 1 = y', as was required. □ 

Theorem 5.2. Suppose that X is a finite set and let C he a periodic 
shift. Let H 6e a non-trivial variety of finite groups. Then the maximal 
subgroup G{^) of J{^) C F-^{X) is a free pro-H group of rank 1. 

Proof. Let ti be a primitive word such that J^T is the orbit of . . . uuu.uuu .... 
We claim that the maximal subgroup K of J(j2r) containing is generated 
byu^+^ This fact is a special case of [10, Theorem 7.5], but it can proved in 
an easier way. An elementary result of Restivo [27] shows that if C C X~^ is 
a code such that C"*" is pure, i.e., closed under extraction of roots, then the 
syntactic semigroup of C"^ is aperiodic (see also [24, Chapter 7, Exercise 8]). 
Clearly u'^ is closed under extraction of roots (by primitivity of u) and so its 
syntactic monoid S is aperiodic and hence belongs to H. If r/: F^{X) — > S 
is the canonical extension of the syntactic morphism, then r]{K) = r]{u^) = 
r]{u'^), where the first equality holds by aperiodicity, whereas the second 
is immediate from Lemma l5.ll We conclude K C r]~^T]{u'^) = u+. Since 
(u'^+i) is the unique maximal subgroup of tt+, this establishes the claim. 

Since K is procyclic, it is free pro-H if and only if every cyclic group 
from H is an image of it. Let n be an integer such that H contains a cyclic 
group of order n. Since {u,u) is the unique pair in {u} x {n}, Lemma l5.ll 
with m = 2 immediately yields that the code {n} has synchronizing delay 
at most 1. Therefore, if T is the syntactic semigroup of {n"}^, then each 
maximal subgroup of T is in the variety of finite groups generated by Z„, 
by [24, Chapter 7, Corollary 2.14] and hence T € H (this can also be deduced 
from S being aperiodic and the result of Weil on subgroups of the syntactic 
semigroup of a composed code [35]). Clearly, a necessary condition for 
[u"'''~'']t = [m"''''^]t is that r = k mod n. Consequently, ([w]j''^"^) must in fact 
be a cyclic group of order n. Putting together what we have just shown, 
we see that K = maps onto the cyclic group of order n whenever it 

belongs to H. We conclude that K \s a, free pro-H group of rank 1. □ 

A fact that we shall use in the following theorem is that if V is a variety 
of finite semigroups containing all finite semilattices such that V = V * D 
and ^ , '3^ are conjugate sofic shifts, then the syntactic semigroup of L(j2r) 
belongs to V if and only if the syntactic semigroup of L{'3^) does [15]. 

Theorem 5.3. Suppose that X is a finite set and let J^T C X^ be an ir- 
reducible sofic shift. Suppose that H is a variety of finite groups closed 
under extension such that the syntactic semigroup of L{^) belongs to H 
and Tj/pTj € H for infinitely many primes p. Then the maximal subgroup 
G{^) of J{^) C Fjj(X) is a free pro-H group. If ^ is minimal, then 
G{^) is procyclic; otherwise it is free pro-Yl of countable rank. 
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Proof. By Theorem 15.21 we may suppose that ^ is not minimal. Because 
H = H*D, the isomorphism class of the maximal subgroup of J(^) depends 
on only up to conjugacy by [14]. 

Lemma 13.151 and the observation made in the paragraph before the the- 
orem, allow us to assume that there exist an idempotent e G J{^) and a 
word z € so that e = z^e and alph(z) C alph(^). By possibly shrinking 
or enlarging the alphabet, we may assume without loss of generality that 
X = . . . , Xn+i} where alph(^) = {xi,...,a;n} and that we have an 
idempotent e € J(^) and a word z G {xi, . . . , Xn-i}~^ so that z^e = e and 
xi £ alph(z). Doing this lets us avoid treating the full shift as a special 
case. Instead, we may assume that the syntactic semigroup S*,^; of L(^) 
has a zero element 0. Let Ge be the maximal subgroup at e. Our goal is to 
show that Ge is free pro-H on a countable set of generators converging to 
the identity (that is, free of countable rank). 

It is well known F^(X) is metrizable [3,30], and hence so is Ge- Thus 
the identity e of Ge has a countable basis of neighborhoods. We shall use 
a well-known criterion, going back to Iwasawa [21], to establish that Ge is 
free pro-H of countable rank. An embedding problem for Ge is a diagram 

Ge (5.1) 

with € H and (p,a epimorphisms {(p continuous). 

A solution to the embedding problem (|5.ip is a continuous epimorphism 
If: Ge ^ H making the diagram 



Ge 



commute. (The terminology "embedding problem" comes from Galois the- 
ory.) According to [31, Corollary 3.5.10] to prove Ge is free pro-H of count- 
able rank it suffices to show that every embedding problem (j5.ip for Ge has 
a solution. We proceed via a series of reductions on the types of embedding 
problems we need to consider. The initial reductions are nearly identical to 
those in [29,33]. 

So let us suppose that we have an embedding problem for Ge as per ()5.ip . 
The reader is referred to [30, Chapter 3, Section 1] for basic properties of 
profinite semigroups and projective limits; see also [31] for the analogous re- 
sults in the context of profinite groups. Let A: F-^{X) — > S^- be the contin- 
uous extension of the syntactic morphism of L(^); note that A(x„+i) = 0. 
Let {S'ijigD be the inverse quotient system of all finite continuous images of 
-Fjj(Ar) such that A factors through the projection vrj : F^{X) S^. Then 
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Fjj(X) = lim .^^ Si. Since Ge is a closed subgroup of F^{X), it follows from 
basic properties of profinite spaces that Ge = lim ^^^ TTi{Ge) (see [31, Corol- 
lary 1.1.8]). Since ip is an onto continuous map to a finite group it follows 
that If factors through irild some i £ D (i.e. kervTjlG^ C ker ip) [31, 
Lemma 1.1.16]. Setting S' = Si and (/?' = vrj, we conclude there exists a 
continuous onto homomorphism ip' : F^{X) S' with S' a finite semigroup 
in H such that ker (p'lce ^ ker ip and ker ip' C ker A. 

Set K' = (p'{Ge) and let p: K' ^ K be the canonical projection. Defining 
H' to be the pullback of a and p, that is, 

H' = {{h, k') e H X K' \ a{h) = p{k')}, 

yields a commutative diagram 




where p* is the projection to H and a' is the projection to K'. It is easily 
verified that all the arrows in the diagram are epimorphisms. So to solve 
our original embedding problem, it suffices to solve the embedding problem 

Ge (5.2) 

as the composition of a solution to (j5.2p with p* yields a solution to (j5.ip . In 
other words, reverting back to our original notation, we may assume in the 
embedding problem (jS.ip that the map (f is the restriction of a continuous 
onto homomorphism ip: F^{X) S with 5 G H and kevip C ker A. 

By Lemma [3.141 J = ip(J{J^)) is a regular ^-class of S and the group 
K = ip{Ge) is a maximal subgroup of J. By SectionSJ the right Schiitzenber- 
ger representation pj: S ^ RM j{S) of S on J is faithful when restricted to 
K. Moreover, Hip: S ^ Sx is the canonical projection, then kerpj C kexip 
by Lemma r3.14|, [30, Proposition 4.6.37] and [30, Equation (4.8)] since S,^: is 
an AGGM-semigroup with distinguished ^ -class Jq and J is minimal with 
ip{J) C Jq. Possibly replacing S by its image under the Schiitzenberger 
representation, we may then assume that the right Schiitzenberger repre- 
sentation of S on J is faithful (recall that from the results of [30, Chapter 
4, Section 6] p,j{J) is a regular ^-class of RM j(5) and the Schiitzenberger 
representation of pj{S) on it is faithful). Therefore, we may view S as 
embedded in the wreath product K I {B, RLMj(5)). Moreover, J is then 
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the unique minimal non-zero ^-class of S [30, Proposition 4.6.29]. Conse- 
quently, Lemma 13.141 implies the following lemma. 

Lemma 5.4. Let u € F^{X). Then u G L{S^) if and only if ip{u) / 0. In 
particular, ip{xn+i) = 0. 

The existence of a solution to (jS.ip is then a consequence of the following 
technical lemma whose proof we defer to Section [6l 

Lemma 5.5. Let ip: F^{X) ^ S be a continuous surjective morphism with 
S finite and ker(^ C kerA such that f{Ge) = K and the Schiitzenberger 
representation of S on the ^ -class J = ip{J{^)) is faithful. In particular, 
J is regular and is the unique minimal non-zero ^ -class of S. Suppose that 
a: H ^ K is an epimorphism of finite groups. Then there is an X -generated 
finite semigroup S" S H such that if rj: F^{X) S' is the continuous 
projection, then: 

(1) there is an isomorphism 9: G^(e) H where G^i^e) ^•s ^he maximal 
subgroup of S' at r]{e); 

(2) if factors through rj as prj where p: S' ^ S satisfies p9^^ = a. 

Assuming the lemma, our desired solution to the embedding problem 
(jS.ip is if = 9r]\Ge : Ge ^ H . Indeed, r/lc^ : — > Gj,(e) is an epimorphism 
by Lemma 13.141 (as ker C ker ip C ker A) and hence Lp is an epimorphism. 
Moreover, a^p = p9~^9rj\G^ = flce and so ip is indeed a solution to the 
embedding problem (15. ip . This completes the proof of Theorem 15.31 □ 

Since the full shift is an irreducible sofic shift, an immediate corollary 
is the main result of [33] (although the proof of that result is simply a 
specialization of the current proof) . 

Corollary 5.6. Let H be a variety of finite groups closed under extension, 
which contains Z/pZ for infinitely may primes p. Then the maximal sub- 
group of the minimal ideal of a finitely generated (but not procyclic) free 
pro-H semigroup is a free pro-H group of countable rank. 

It follows from our main result and Proposition 13.16] that there is a dense 
set of idempotents in F^{X) whose corresponding maximal subgroups are 
free pro-H. 

6. The proof of Lemma [575] 

We retain the notation of the previous section. In particular, recall that 
X = {xi, . . . ,Xn+i}, there is a word z G {xi, . . . ,x„_i}+ so that = e, 
xi £ alph(z), e is an idempotent of J{^) and a\p\r\(^) = 
Assume that Z — ^1 ' ' ' with. Zi G , . . . , Xfi—i } for i = 1, . . . ,g. 

Proof of Lemma 1 5. 51 Let B be the set of .jSf-classes of J. Since we are 
assuming the Schiitzenberger representation of on J is faithful, we can 
view 5 as a subsemigroup of K I (S, RLM j(5)), that is, as a semigroup 
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of 6 X 6 row monomial matrices over K where b = \B\. Denote by 1 the 
^-class of (p{e). We order the elements of B with 1 first when we write 
our matrices. The discussion in Section |4] shows that the embedding can 
be chosen so that the row monomial matrix associated to an element k of 
the maximal subgroup K at (p{e) has k in every non-zero entry of the first 
column and in the remaining columns. Moreover, the 1, 1-entry of the 
row monomial matrix associated to k is k. For x € F^{X), denote by 
the row monomial matrix associated to ^{x). We shall distinguish formally 
between Mj. and (p{x), although = My if and only if ip{x) = ip{y). 

Let N = kera and choose a set-theoretic section a: K H. Then 
H = N(t{K). For X G F^[X), denote by the hxh row monomial matrix 
over H obtained from Mx by applying a entry-wise. Let m be a positive 
integer such that (M^^ • • • MJJ™ is idempotent in Hl{B, RLMj(S')). Choose 

a prime p > max{m, |A^|'', so that Z/pZ G H; such a prime exists by 

our assumption on H. Denote by Cp the cyclic group of order p generated by 
the permutation (1 2 - ■ ■ p). Our semigroup S' will be a certain subsemigroup 
of the iterated wreath product 

Q = HUB, RIM J iS))l{[p],Cp) 

where [p] = {1, . . . ,p}. Observe that Q € H since H closed under extension 
implies that H is closed under wreath product [18,30]. The reader is referred 
to [1] for more on taking a wreath product of a semigroup with a group with 
constant maps. 

We begin our construction of S' by defining 





Xl 







Xl 













MS, 


























MS, 














In other words xi acts on the [p]-component by the cyclic permutation 
(12 ■■■p) and each block entry of xi from H I {B, RLM j(S')) is MS,. For 
2 < i < n — 1, we set 



Xi 









MS- 














MZ 



So Xi acts on the [p]-component as the identity map and each block entry 
of Xi from if ; (S,RLMj(5)) is M^^, for i = 2, . . . , n - 1. 

To define Xn will require some extra notation. Set I = \N\^; so p > £ 
by choice of p. Let 1 = A''i, A^2 • • • , be the distinct elements of A^^. We 
identify N'^ with the group of diagonal 6x6 matrices over N. In particular, 
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A^'' is a subgroup of H I (B, RLMj(S') U {1b})- In fact, there is a natural 
onto homomorphism 

a:Hl{B, RLMj(5)) ^Kl{B, RLMj(5)) 



induced by a : H ^ K; the map a simply applies a entry-wise. Moreover, it 
is straightforward to verify that a{U) = a{V) if and only if U = NjV some 
1 < J < ^- Indeed, if we denote by Ui (respectively Vi) the non-zero entry 
(if there is one) of row i of U (respectively V), then a{U) = a{V) implies 
a{ui) = a{vi) for all i and so we can find rii E N such that Ui = riiVi for all 
i (where if z is a zero row of u and v, then we may choose arbitrarily). 
We may then take Nj = diag(ni, n2, . . . , n^,). Dually, U = VNf^, some k. 
Next let us define a p x p block row monomial matrix 








NeM-^ 












so Xr 



has all its block entries in the first column. The j*'* block entry of the 
first column is NjM^ if j 1^ ^ and otherwise is . Finally, let Xn+i = 0. 
Then xi, . . . , Xn+i G Q and we have a map X Q given by Extend 
this to a continuous morphism 77: F^{X) — > Q and set S' = r]{F^{X)). Our 
goal is to show S' is the desired semigroup. We begin by verifying that ip 
factors through r]. 

Proposition 6.1. Let u G F-^{X). Then rj{u) = if and only if ip(u) = 0. 
Moreover, if rj{u) 7^ 0, then rj{u) is a block p x p-matrix in which each block 
row contains a (non-zero) block entry U e H I {B, RLM j(5)), and for every 
such block entry one has a{U) = M^. As a consequence, r){u) = r}{u') 
implies (p{u) = ip{u') and so ip factors through rj as pr) where p: S' ^ S 
takes r]{u) to a{U) where U is any block entry of r](u). 

Proof. The final statement follows from the previous ones since r]{u) = r]{u') 
then implies = M„/ and so ip(u) = p{u'). 

We next prove the remaining part of the statement for words u G X+ by 
induction on length, the case \u\ = 1 being trivial. The result is also trivial 
for words containing Xn+i, so we only deal with words not containing this 
element. Suppose that w = XiU with 1 < i < n and u G X'^. By induction 
<p{u) = if and only if r/(n) = and so it only remains to deal with the case 
p{u) 7^ and ri(u) ^ 0. We recall that since the wreath product consists 
of row monomial matrices, each block row of an element of Q can have at 
most one block entry. 
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Let 1 < j < p. By induction, r](u) has a unique (non-zero) block entry 
Uj in the j*'*-block row. The definition of Xj impUes that the j^'^-block row 
of r]{w) is obtained by multiplying each entry of a certain block row ^(j) of 
r]{u) on the right by N^.M^. for some N^^ G (perhaps the identity). So 
the only candidate to be a block entry of block row j of r]{w) is Nj.. ■ 
We claim that either N^.M^.U^i^j-^ is a (non-zero) block entry in the j^^-iow 
of rj{w) for all 1 < j < p, or ri{w) = = ^{w). 

By induction, a{U^(^j-j) = (p{u), thus we have 

a{NkM^^U^^^)) = M^^U^^j)) = fixiMu) = ^{w) = (6.1) 
for j = 1, . . . ,p. Now the diagram 

H I (B, RLM j(5)) ^ K I {B, RLM j(5)) 




RLMj(S) 

commutes, where the bottommost arrows are the wreath product projec- 
tions. Since an element of a wreath product L I (A, Z) is zero if and only if 
its image under the wreath product projection is zero, it follows from (j6.ip 
that NkM^XJ^^j) = for some 1 < j < p if and only if NkM^JJ^(^j) = for 
all 1 < i < p, if and only if '^{w) = 0. Therefore, r]{w) = if and only if 
(p{w) = 0, and if neither is then (|6.ip implies that, as a block p x p-matrix, 
each block row of 'q{w) has exactly one (non-zero) block entry, and each 
block entry is an a-preimage of M^. 

If u G Fjj(X), then since is dense in Fjj(X) and r]~^rj{u), ip~^ip{u) are 
open, there exists a word w G such that r]{u) = r]{w) and (p{u) = f{w). 
The result now follows from the case of words. □ 

It now follows that kerr/ C ker A and so Lemma [3 . 141 yields J' = r]{J{^)) 
is an entire regular ^-class of 5". Lemma 15.41 established '^{u) = if and 
only if u ^ L{^). Thus by Proposition 16.11 we conclude ry(u) = if and 
only if u ^ L(^) and hence J' is the unique minimal non-zero ^-class of 
S'. Notice that p{J') = p{rj{J{,^))) = ip{J{^)) = J. In particular, J' is 
minimal with p{J') ^ J and so Lemma 13.71 applies. 

Our next goal is to show that if u & L(^) is a word with Xn G alph(n), 
then every preimage of M„ under a is a block entry of f]{u). This will 
be crucial in showing that the maximal subgroup of r]{J) is isomorphic 
to H. To effect this we shall need the following lemma. Notice that if 
U is any preimage of M„, then the complete set of preimages of M„ is 
{NiU, . . . , NiU} = {UNi, UNe} (note that if M„ has any zero rows, 
then these elements are not distinct). 

Lemma 6.2. Let u,w ^ F-^{X) and suppose U is a fixed preimage of 
under a. Then every preimage of M^w (respectively, M^u) under a is of 
the form UW (respectively, WU ) for some preimage W of under a. 
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Proof. Let M be a preimage of M^w under a. Since UM^ is a preimage of 
Muw under a, it follows that M = UM^Ni for some 1 < i < i. But then 
W = M^Ni is an a-preimage of and M = UW. The statement for M^^u 
is proved dually. □ 

Observe that ifw & X+ and Xn € a I ph (?/;), then by definition of xi, . . . , 2?ri, 
the block entries of ri{'w) form a single column, in other words, the ([p], Cp)- 
component of r]{w) is a constant map. We can now prove the aforementioned 
fact concerning preimages. 

Proposition 6.3. Let w G L{3^) with x„ G alph(w). Then the set of 
preimages of under a is the set of block entries of r}[w). 

Proof. Let R be the set of words w G L{^) with x„ G alph(tt>). We proceed 
by induction on \w\ for w (z R. If |w| = 1, then the proposition follows from 
the definition of x„. 

Suppose it is true for words in R of length n and let w (z R have length 
n + 1. Let be a a-preimage of Mw If the first letter of w is x„, then 
w = vxi with V € R, some i; else w = XiV where v G R and 1 < i < n — 1. 
In the latter case, by Lemma 16.21 we have W = M^.V for some a-preimage 
V of M^. By induction hypothesis, y is a block entry of i]{v). Then, since 
r]{w) = r](xi)rj{v), it follows from the definition of r/(xi) that M^_V is a block 
entry of r]{w). 

In the case w = vxi for some v R and some i, the block entries of rj{v) 
are in a single column, say column j. Let [/ be the block entry in row j 
of Xi] by construction it is an a-preimage of Mr.. By Lemma 16.21 we have 
W = VU for some a-preimage V of My. By induction hypothesis, y is a 
block entry of r}{v), and so it is in column j of r]{v). Hence VU is a block 
entry of r][w). □ 

A continuity argument allows us to extend the above result beyond words. 

Corollary 6.4. IfwG J{^), then the block entries of r]{w) are in a single 
column and the set of preimages under a of Mw is the set of block entries 
ofr]{w). 

Proof. Consider the continuous homomorphism c: F^{X) (P(X),U) de- 
fined by setting c(x) = {x} for x € X. Recall that we are assuming 
that {xi,...,Xn} = alph(,^). Since L{^) is irreducible, we can find 
words vi, . . . , Vn-i so that xiViX2 ■ • • Xn-iVn-iXn G L(^). It follows that 
alph(,^) G c(L(jr)) = c(L(^)) (the latter by continuity). By minimal- 
ity of J(c^), we conclude that c{J{^)) = {alph(<^)}. Thus if {wr} is a 
sequence of words in converging to w, then there exists R > such 
that, for r > R, we have a\ph{'Wr) = c{wr) = alph(<^). The semigroup S' 
is finite so there exists s > R with r]{w) = r]{ws) by continuity of r/. Re- 
membering that (p = pr], this implies that (p{w) = (p{ws), or equivalently 
that M^ = Mu,^. As a\ph{ws) = alph(,^) = {xi, . . . ,Xn}, the corollary 
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now follows from Proposition 16.31 and the remark preceding that proposition 
applied to Ws- □ 

Recalling that fij: S ^ RLM j{S) denotes the canonical projection, ob- 
serve that T = fj,j{J L) {0}) is a transitive semigroup of partial transforma- 
tions of B of rank at most 1 containing the empty map. By Corollary 16.41 
if If G J{^), then the ([p], Cp)-component of rj{w) is a constant map, that 
is, the block entries of r][w) appear in a single column. Moreover, Propo- 
sition 16.11 shows that each block entry of r][w) is a preimage of under 
a. Hence, J' C H I {B,T) ! ([p],M). Moreover, {B,T) I ([p],M) is easily 
verified to be a transitive semigroup of partial transformations of rank at 
most 1. Indeed, each entry of an element of {B,T) I ([p], \p]) has all of its 
block entries in a single column and each non-zero element of T is a rank 1 
partial transformation. The transitivity is immediate from the transitivity 
of T and [p] since if {b,i), {b' , j) £ B x \p] and bt = b' with t £ T, then 
(b,i)D = {b',j) where the block entries of D are all in column j and each 
block entry of D is t. Lemma l4.ll now implies that H I {B,T) I ([p], [p]) is 
0-simple. 

It remains to construct an isomorphism 9 : G^(e) — > H such that p9'^ = a. 
Corollary 16.41 yields that all the block entries of r/(e) belong to a single 
column. By cyclically permuting the names of the elements of [p], we may 
assume without loss of generality that r/(e) is a block matrix with each block 
entry in the first column. Also, the discussion in Section [H indicates Me is 
a matrix whose only non-zero column is the first column and whose non- 
zero entries are comprised of the identity of K; moreover, the 1, 1-entry of 
Me is the identity of K. Since the block entries of 77(e) are preimages of 
Me under a (Proposition 16. ip . we deduce that all the non-zero entries of 
r]{e) are in the first column and belong to A^. Lemma 14.11 says that the 
map Q: H I {B,T) I ([p], [p]) — > H selecting the 1, 1-entry of a matrix is an 
isomorphism from the maximal subgroup at 77(e) of Hi [B, T) I ([p], [p]) to H. 
In particular, 7/(e)ii is the identity of H. We shall show that the restriction 
of G to G^(e) is onto and p6~^ = a. This will require a little preparation. 

Proposition 6.5. If u £ Ge, the ip{u) = 0(7/(71)11). 

Proof. Corollary 16.41 implies that all the block entries of 7/(u) are in a single 
column. In fact, they are all in the first column since we just saw that this 
is the case for r/(e) and rj[u) = r]{u)r]{e). Proposition 16.11 implies that M„ is 
the matrix obtained by choosing any block entry of 'r](u) and applying a. In 
particular, M„ is the result of applying a entry-wise to the 1, 1-block entry 
of rj{u) and so [M^jjn = a{r]{u)ii). 

Now if A: S K, then according to first paragraph of the proof of Lemma [5.5l 
the row monomial matrix associated to k has 1, 1-entry k. In particular, since 
(p{u) G K, it follows that [M^Jn = (p{u). The last statement of the previous 
paragraph then yields (p{u) = 0(77(71)11), as required. □ 

The proposition admits the following corollary. 
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Corollary 6.6. The equality aO = p\g^(^) holds. 

Proof. Recalling that selects the 1, 1-entry of an element of G^(e), Propo- 
sition 16.51 shows that ip = aOr] as maps from Gg to K. By definition of p 
there is a factorization ip = prj and hence, in fact, prj = a9r]: Ge — > K. But 
ri{Ge) = Gr){e) by Lemma [3.141 so we conclude that p\Gr,(e) ~ ^ *° 
be proved. □ 

Since 9 is injective, being a restriction of the isomorphism Q, Corollarv l6.6l 
immediately yields that if 6 is onto, then a = p6^^. Thus we are left with 
proving 9 is onto. Since J' is the minimal ^-class with p{J') ^ J (as 
was already observed) p must take G^(e) onto K by Lemma 13.71 It follows 
from Corollary 16.61 that a maps 0(G^(e)) onto K. Recalling kera = A^, we 
conclude H = iV0(G^(g')) and so to complete the proof it suffices to establish 
that N is contained in the image of 6. 

Recall that we have a word z = zi ■ ■ ■ Zq such that Zi € {xi, . . . , Xn-i}~^, 
for i = l,...,q, the letter xi is a factor of z and z^e = e. Set Z = 
M"^ ■ ■ ■ G H I (B, RLM j(S')). Let us remind the reader that our prime p 
was chosen so that p > m where = Z^ and p > • Thus, we can find 
a positive integer r so that 1 = rm\z\xi mod p. Direct computation shows 
that 






Z'^ 
















Z'^ 
















































since every block entry of ri(z) is Z and 7]{z) acts in the [p]-component by 
the permutation (1 2 Set C = ri{zY"^. Then has the block 

form of the permutation matrix corresponding to (1 2 • • • py and each block 
entry of is Z'^ . In particular, the effect of multiplying a matrix D on 
the left by is to permute the rows of D according to the permutation 
(1 2 • • ■p)~^ and to multiply each row of D on the left by Z"^. 

Notice that 77(e) = r]{z)'^r]{e) as z^e = e. But r]{z)^ is a p x p-block 
diagonal matrix with Z^ as each diagonal block. Thus the set of elements 
of the form Z'^U with U a block entry of r]{e) is precisely the set of block 
entries of r]{e), which is precisely the set of preimages of Me under a by 
Corollary 16. 4[ Each preimage of Me is therefore the 1, 1-block entry of a 
product C-' 77(e) for a correctly chosen j as (1 2 ■ ■ ■ p) acts transitively on 
{1, ... ,7?} and all the block entries of r](e) are in the first column. 

Now Me is a matrix all of whose non-zero entries are the identity of K and 
belong to the first column; moreover, the 1, 1-entry of Me is the identity of 
K. It follows that the a-preimages of Me are precisely those matrices with 
first column having entries from = ker a in those rows that are non-zero 
in Me and whose remaining columns consist of zeroes. Consequently, any 
element of can be the 1, 1-entry of an a-preimage of Mg and so every 
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element /i € is [C^rj{e)]ii for some j (as an entry, not a block entry). 
Since r]{e)u is the identity of H, it follows r]{e)C^ r]{e) has 1, 1-entry h, and 
in particular is a non-zero element of S' . Thus r](e)C^ ri(e) is an element of 
G^(e) by minimality of J' among non-zero ^-classes of S'. By construction, 
9{ri{e)C^r]{e)) = h and so 9{Gn[e)) contains N as required. This completes 
the proof of Lemma 15.51 thereby establishing Theorem 15.31 □ 

7. Computing idempotents in the ^-class of a sofic shift 

Let X be a finite alphabet. An element w of X+ is said to be (polynomial 
time) computable if there is an algorithm which on input an X-tuple {sx)x<^x 
of elements from a finite semigroup S, computes (in time polynomial in 
the value '^{w) where X+ — > S" is the canonical extension of the map 
X ^ Sx- The existence of a computable idempotent in the minimal ideal of 
X+ was proved independently by Reilly and Zhang [26] on the one hand, 
and by Almeida and Volkov [9] on the other. The Reilly-Zhang idempotent 
was shown to be polynomial time computable in [9]. 

Let ^ be an irreducible sofic shift over an alphabet X. Our goal is to 
construct a computable idempotent in J(^). In fact, we give an algorithm 
which is uniform in the sofic shift, given as input via a so-called irreducible 
presentation. First we need a lemma. 

Lemma 7.1. Let X C he an irreducible sofic shift whose syntactic 
semigroup is in a variety V of finite semigroups. Let l: X"*" F\-{X) be 
the canonical morphism. Then u £ i{L{^)) belongs to J{^) if and only if 
each element of l{L{^)) is a factor of u. 

Proof. Clearly each element of i{L{^)) is a factor of each element of J{^) 
by minimality of J{^). Suppose conversely, that each element of i{L{^)) 
is a factor of n G i{L{^)). Let v G J(^) and write v = lim<,(t'„) with the 
Vn in X~^ . Since i{L{^)) is clopen, it follows that, for all n sufficiently large, 
i{vn) £ i(L(^)) n l{X+) = t(L(jr)) (since L(^) is V-recognizable [3]). 
Hence we may assume that u„ € L{^) for all n. By hypothesis on u, we can 
find, for each n, elements r„, s„ € F-y[X) so that rni{vn)Sn = u. Passing to 
a subsequence, we may assume tlia-t t^i — > r, Sn — > s for some r, s G F-v{X). 
Then u = rvs and so u G J{^) by minimality of J{^). □ 

The following can be found in [25, Chapter 3]. For an irreducible sofic 
shift there is a strongly connected graph F with non-empty set E of 
edges, and a map tt: E ^ X such that, if P is the set of paths in F then, 
denoting the unique extension of vr to a homomorphism E~^ X~^ also by vr, 
we have tt{P) = L[^). We say that (F,7r) is an irreducible presentation of 
^ . In other words, an irreducible presentation is a strongly connected non- 
deterministic automaton, all of whose states are initial and final, recognizing 

L(jr). 
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We shall reduce our problem to producing a computable idempotent in 
the kernel of a clopen subsemigroup of X+. 

Lemma 7.2. Let (F, vr) he an irreducible presentation of a sofic shift X C 
and let v be a vertex of T. Let T C be the rational subsemigroup 
of all words in reading a loop at v. Then each element of the minimal 
ideal ofTCL X+ belongs to J{^). 

Proof. By construction, T C L{3t^) and hence T C L(^). Suppose t be- 
longs to the minimal ideal of T. Then each element of T is a factor of t. 
But since F is strongly connected, each word labeling a path in F is a factor 
of an element of T. Thus t G J{^) by Lemma l7.ll □ 

In light of Lemma l7.2t to achieve our goal, it suffices to construct a com- 
putable idempotent pT in the minimal ideal of T for each rational subsemi- 
group T C X'^ . Moreover, our algorithm will be uniform in T (meaning, 
given an automaton for T and an X-tuple of a finite semigroup S, we can 
compute the value of px on this X-tuple). 

Lemma 7.3. Let L C X^ be a rational subset and (p: X^ S a homo- 
morphism. Then each element in ^{L) can he represented by a word in L of 
length at most m[\S\-\-\) — 1 where m is the number of states of the minimal 
automaton for L. 

Proof. Let = {Q,X,5,qo,F) be the minimal automaton for L and con- 
struct an automaton ^ = {Q x , X, A, {qq,!), F x S) where {q,s)x = 
{qx, s(p{x)) describes the transition function. Then s G fiL) if and only if 
there is a word w € X^ reading in ^ from (go, 1) to a state of the form 
(g, s) with q € F. Since ^ has md^l + 1) states, such a word can always be 
chosen to have length at most mdSI + l) — 1. □ 

We can now construct our idempotent using the 'Zimin word' idea of 
Reilly and Zhang (see also [9]). We assume that the alphabet X is totally 
ordered. The shortlex order is defined on X+ by putting u < v \i \u\ < \v\ 
or \u\ = \v\ and u lexicographically precedes v. 

Theorem 7.4. Let T C X^ be a rational subsemigroup. Let vi,V2,... 

be the elements of T in shortlex order and put wi = vi and Wn+i = 
(wnVn+i'Wn)^"''^^^' for n > 1. Then the sequence {wn} converges to a com- 
putable idempotent px of the minimal ideal ofTQ X~^ . 

Proof. First of all, since T has decidable membership and there is a Turing 
machine that enumerates X"*" in shortlex order, clearly there is a Turing 
machine that can compute the element Wn of the sequence given n as input. 
Let (/?: X~^ ^ 5 be a morphism where 5 is a finite semigroup of order k. 
Let m be the number of states of the minimal automaton of T. Put r = 

m(A: + l)-l and N = |X| + |XpH h|X|''. We claim that p{wn) = p{wn) 

for all n > and that ip{w]\f) is an idempotent of the minimal ideal of ^{T). 
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It will then follow that {wn} converges to a computable idempotent in the 
minimal ideal of T. 

First observe that for n > k, the elements (p{wn) form a descending chain 
of idempotents. Now, by choice of A'^, for n > N, every word in T of length 
at most r is a factor of Wn- Lemma 17.31 then yields that every element of 
ip{T) is a factor of if{w„); consequently, f{wn) is an element of the minimal 
ideal / of f{T). But I is a completely simple semigroup and so contains 
no strictly descending chains of idempotents. Thus f{wn) = ^p{wj\f) for all 
n > N. This completes the proof. □ 

The proof shows the construction is uniform in T. Applying Lemma ESI 
we obtain: 

Corollary 7.5. If ^ Q is an irreducible sofic shift, then there is a 
computable idempotent in J{^). 

We leave it as an open question whether the polynomial time algorithm 
in [9] to compute the Reilly-Zhang idempotent (which is our idempotent for 
T = X~^) can be extended to arbitrary rational subsemigroups. 

8. Entropy 

Let ^ he a shift of X^. The complexity function of 2^ is the map qx 
that assigns to each positive integer n the number of elements of L(j2r) 
with length n. This map satisfies the property g^(n + m) < q,^{n) •g^ (m). 
As proved in [25, Lemma 4.1.7], this property implies the convergence of 
the sequence log2 q,^{n)} to its infimum h{^), called the entropy of ^ . 
Complexity functions and entropy are fundamental notions in symbolic dy- 
namics. In [10] these notions were adapted to the elements of Fy{X), where 
V is a variety of finite semigroups containing LSI. More precisely, the com- 
plexity function of an element w of Fy{X) is the map g^o that assigns to each 
positive integer n the number of finite factors of w with length n; this map 
also satisfies qw{n + m) < qw{n) ■ qw{m), and so, ii w ^ the sequence 

log2 ^toC"-)} converges to its infimum h{w), called the entropy ofw. The 
entropy of elements of X* is defined to be 0. 

One should be more precise and say that in [10] the entropy of w £ 
Fy{X)\X^ is defined as the limit of log|x| Qwin)}, which is h{w) log|x| 2 
according to our definition of h{w). The two definitions are essentially the 
same, but ours does not depend on the alphabet, and it is more consistent 
with the usual definition of entropy of a shift. 

Next we recall from [10] some properties about the entropy of elements 
of Fy{X), starting with the following: 

h{uv) = mayi{h{u) , h{v)} . (8.1) 

In particular, the set of elements with entropy less than is a subsemi- 
group of -Fv(^)- It is well know that the elements of relatively free profinite 
semigroups have an operational interpretation. Under this interpretation. 
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these elements are called implicit operations; see [3] for details. We may 
compose implicit operations. Then ()8.ip has the following generalization: if 
71! is a r-ary implicit operation over V, then 

h{w{vi,. . .,Vr)) < max{h{w) ■ log\x\ 2 • log\x\ r, h{vi), . . . ,h{vr)}. (8.2) 

If is a finitely generated profinite semigroup, then the monoid End(S') 
of continuous endomorphisms of S is a profinite monoid, considered with the 
pointwise topology, which coincides with the compact-open topology [6]. For 
each if € End(S'), elements of the subsemigroup of End(5) generated by tp 
are of the form ip^ , where the exponent u is an element of the profinite 
completion N of N (details can be found in [10]). It was proved in [10] that 

m.ayih[ip^ [x)) < m.ayih{ip{x)) (8.3) 

for every w € F-y{X) and E N\ {0}. A subset W of F-y{X) is closed under 
iterations if y?(x) G W implies pf{x) G W , for all G N \ {0} and x G X. 
Note that by ()8.3p the semigroup Sk is closed under iterations. 

An important application of these results was given in [10]: it is easy to 
prove that an element w of Fy{X) belongs to the minimal ideal Kx if and 
only if h[w) = log2 hence one immediately concludes that F\-{X) \ Kx 
is a semigroup closed under iterations and composition with r-ary implicit 
operations w such that h{w) < (log2 \X\)'^ ■ log,, \X\. The minimal ideal 
Kx is the ^ -class associated to the full shift X^. We are going to prove 
analogues of these results for sofic shifts. 

Let F{w) be the set of finite factors of w. Suppose that L{^) is factorial. 
If w G then F{w) C L(^), and so h{w) < h{^). Note that h{w) = 

h{^) if w G J(jr), since F{w) = L{^) if w G J(^). The following 
proposition gives a converse. It is an analog of [25, Corollary 4.4.9], stating 
that if is a subshift strictly contained in a sofic shift ^ then h{'3^) < 
h{S^). The proof of the proposition consists in a reduction to this result. 

Proposition 8.1. Let \ he a variety of finite semigroups containing LSI. 
Suppose ^ is a non-periodic irreducible sofic shift such that L(^) is a 
factorial subset ofFv{X). If w e L{^) \ J(jr) then h{w) < h{,^). 

Proof. If w G X~^ then h{w) = 0. Since =^ is a non-periodic irreducible sofic 
shift, we have h{^) > [25, Corollary 4.4.9], therefore we may suppose that 
w i X+. 

Let {wn\ be a sequence of elements of L(^) converging to w. Let 
A: X~^ — > S^f; be the syntactic morphism for L(^). Taking subsequences, 
we may suppose that \wn\ > 2|5^| +n for all n. From the proof of [3, Prop. 
3.7.1] we conclude that given a homomorphism ^: — > T onto a finite 
semigroup T, then, for every z G such that \z\ > \T\, there are zq, Z2 G B* 
and zi G -B"*" such that z = zqZiZ2, \zoZi\ < \T\ and ip{zi) is idempotent. 
Of course the dual result holds as well. Applying this result to the syn- 
tactic morphism A, and to the prefix and the suffix of length | of Wn, 
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we conclude that Wn = Wn,oWn,iWn,2Wn,3Wn,4: for some Wn,i G X* such that 
\wn,o'Wn,i\ < 15*^1 and \wn,3Wn,4\ < 'Wn,i and 'Wn,3 are non-empty words 

whose image under A is idempotent, and \wn,2\ > n. Taking subsequences, 
we may suppose that the sequence of tuples {{wn,o,Wn,i,'Wn,2,Wn,3,Wn,4:)} 
converges to {wo,wi,W2,'W3,Wi). Then w = ■W0W1W2W3W4. Note that 
(wi)'^ = limjfc^oo limn.-»oo('tWn,j)'^'- Since X{wn,i) and X{wn,3) are idempotents 
and X{wn,iWn,2Wn,3) 7^ 0, the word {'Wn,i)^'Wn,2{wn,3)^' belongs to L{^) for 
all k, n. Therefore, the element v = (wi)^ 102(103)'^ belongs to L(^). 

We have h{w) = max{h{wo),h{wiW2Ws),h{'W4^)} by (|8.ip . But wq and 
Wi belong to X^, because the words Wn,o and Wn,4: have bounded length. 
Therefore h{wo) = h{w/i) = 0, and so h{w) = h{wiW2W3). Let p be the 
ternary implicit operation xf 2:22^31 on the three-letter alphabet {xi, xi, X3}. 
Note that v = p{wi, 102,103). Since h{p) = niax{h{xi), h(x2), h{x'^)} = 0, it 
follows from ([O]) that 



So, it suffices to prove that h{v) < h{,9^). 

By Lemma W7\\ the hypothesis w € L{,3^) \ J{3^) implies the existence 
of a word u € L{^) such that u is not a factor of w. 

The language F{v) is clearly factorial, and it is prolongable because v = 
wfvw^ belongs to Fv{X)vFviX). Therefore F{v) = L(^) for some shift 
^. Since v G L{^) and L(jr) is factorial, we know that F{v) C L( JT) 
and U F{w^) C L( JT). The set F{wf) U is the language of 

the union of two periodic shifts, whence F{w'^) U F(w2) 7^ -L(^), else ^ 
would not be irreducible non-periodic. Hence, there is a word u' belonging 
to L{^) but not to F{w'^) U F{w2 )- Since is irreducible, there are x,y 
such that the word u" = uxu'yu belongs to L{^). 

Suppose that u" is a factor of v = WiW2W^. The word u" is not a factor 
of wf or liJg , (because is a factor of u"), nor of W2 (because u is a factor 
of u" and W2 is a factor of By [10, Lemma 8.2] and the fact that 
W2 € Fv(X) \ X+, we have u" = for some words s and p such that s is 
a suffix of wf and p is a prefix of W2 , or such that s is a suffix of W2 and p 
is a prefix of ^3 . Suppose the first case occurs. Then s does not have u' as 
factor, thus s is a strict prefix of uxu' . But then yu is a suffix of which is 
impossible, since u is not a factor of w^- The first case leads to an absurdity, 
and similarly so does the second case. Hence u" is not a factor of v. 



Therefore L(^) C L(^), that is, ^ C JT. By [25, Corollary 4.4.9], this 
implies h{'3^) < h{^). Then it follows trivially from equality F{v) = L{'3^) 



Proposition 18.11 states that L(j2r) \ J{^) is contained in the semigroup 
Sh{s:)i stable under iterations. In general L{^) \ J{^) is not stable under 
iterations, but if we restrict to endomorphisms such that (p{L{^)) C L{^) 
then we obtain a positive result. 



h{v) 



max{/i(i«i), h{w2), h{w3)} = h{wiW2W3) = h{w). 



that hiv) < /i( JT). 



□ 
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Another example in which one obtains a result weaker than in the case 
of the full shift, is the following: if is the ideal generated by J(=^), 

then Sh(,^;) C Fv(X) \ but in general Sh(,^;) ^ Fv(X) \ /( JT) and 

Fy^{X) \ is not stable under iteration. For example, let J^T be a shift 

such that alph(=^) = {a, 6} and let X = {a, 5, c}. Let u G J{^). Consider 
the endomorphisms il) and ip given by 

^(a) = a, ■0(6) = c, ■0(c) = 6, ip{a) = a, ip{h) = '^(■u), (p{c) = b. 
Then /i(0(«)) = ^(u) and ip{ip{u)) = u. Since -(/^(n) ^ /(JT) and n G /(=^), 
it follows that Fy{X)\I{X) and that Pv(^) \^('^) is not stable 

under iteration. On the other hand, Fy{X)\I{^) is a semigroup whenever 
V = A@V [32]. 
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